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We describe a minimal model of an autonomous Maxwell demon, 
a device that delivers work by rectifying thermal fluctuations while 
simultaneously writing information to a memory register. We solve 
exactly for the steady-state behavior of our model, and we construct 
its phase diagram. We find that our device can also act as a "Lan- 
dauer eraser", using externally supplied work to remove informa- 
tion from the memory register. By exposing an explicit, transparent 
mechanism of operation, our model offers a simple paradigm for in- 
vestigating the thermodynamics of information processing by small 
systems. 

nonequilibrium statistical mechanics | thermodynamics of information processing 
Landauer's principle 

A system in thermal equilibrium undergoes random micro- 
scopic fluctuations, and it is tempting to speculate that 
an ingeniously designed device could deliver useful work by 
rectifying these fluctuations. The suspicion that this would 
violate the second law of thermodynamics has inspired nearly 
150 years of provocative thought experiments [1, 2, 3, 4, 5], 
leading to discussions of the thermodynamic implications of 
information processing [6, 7, 8, 9, 10, 11, 12]. Although both 
Maxwell [1] and Szilard [3] famously took the rectifying agent 
to be an intelligent being, later analyses have explored the fea- 
sibility of a fully mechanical "demon" . There has emerged a 
kind of consensus, based largely on the works of Landauer [6] 
and Bennett [7, 8], and independently Penrose [13], accord- 
ing to which a mechanical demon can indeed deliver work by 
rectifying fluctuations, but in doing so it gathers information 
that must be written to physical memory. The eventual era- 
sure of this information carries a thermodynamic cost, no less 
than fe_eTln2 per bit (Landauer's principle), which eliminates 
any gains obtained from the rectification of fluctuations. 

The past few years have seen increased interest in the ther- 
modynamics of information processing [14, 15, 16, 17, 18, 19]. 
Discussions of Maxwell's demon, Landauer's principle and 
related topics arise in contexts such as quantum informa- 
tion theory [20], the synthesis of artificial nanoscale ma- 
chines [21], feedback control in microscopic systems [22, 23, 
24, 25, 26, 27, 28, 29, 30, 31, 32, 33], and single-photon 
cooling of atoms [34]. Experiments have been performed 
with the explicit aim of testing theoretical predictions [27], 
including Landauer's principle [35]. Moreover the consen- 
sus or "favored explanation" [36] described above is widely 
but not universally accepted, as suspicions persist that it as- 
signs an unwarranted thermodynamic significance to random 
data [12, 36, 37, 38, 39]. 

In spite of this attention, the field still lacks a tangible 
example or model of a device that converts heat into work 
at the expense of writing information. Discussions are often 
framed around general principles rather than a particular in- 
stance, and the demon is typically described in generic terms, 
as a system capable of performing microscopic feedback con- 
trol, but otherwise unspecified. In this paper we propose an 
explicit, solvable model of a system that behaves as a Maxwell 
demon. Our device, which extracts energy from a single ther- 



mal reservoir and delivers it to raise a mass against gravity, is 
fully autonomous - it is neither manipulated by an external 
agent nor driven by an explicit thermodynamic force - but in 
order to lift the mass the device requires a memory register 
to which it can write information. 

Briefly, in our model the device, or demon, is a three-state 
system that interacts with: a thermal reservoir, a mass that 
can be lifted or lowered, and a stream of bits that pass by the 
demon in sequence, as sketched in Fig. 1. The demon's dy- 
namics consist of random transitions among its three states. 
These transitions are driven by thermal fluctuations from the 
reservoir, and are coupled to the bits and to the mass in a 
manner described in detail below. The model has three pa- 
rameters: 8 describes the initial statistical state of the bits, 
reflecting the initial ratio of O's to l's; e characterizes the 
weight of the mass; and t is the duration of interaction with 
each bit in the stream. For any set of values (8, e, r) the model 
reaches a unique periodic steady state, characterized by an av- 
erage rate of work performed on the mass, and an average rate 
of information written to the bit stream. 

We will first consider our model in the absence of an exter- 
nal load: the demon generates directed motion while writing 
information to the bits, but there is no provision for harness- 
ing this motion to perform work. We then add a load by 
attaching a non-zero mass, as in Fig. 1, and we solve for 
the model's steady-state behavior. Our model exposes a spe- 
cific mechanism for the operation of a mechanical Maxwell 
demon, allowing us to explore in detail the interplay between 
the gravitational pull on the mass and the changing informa- 
tion content of the stream of bits. Moreover, our demon is 
versatile: it is equally capable of acting as an eraser, using 
the energy of a falling mass to remove information from the 
memory register. 

We now specify our model in detail, by introducing in turn 
its several elements (Fig. 2). The demon evolves by mak- 
ing thermally activated transitions among its three states, la- 
belled A, B and C. We consider transitions in the direction 
A — > B — > C — > A to be clockwise (CW), and those in the op- 
posite direction to be counterclockwise (CCW), see Fig. 2(a). 
The demon exhibits directed rotation if CW transitions occur 
with greater frequency than CCW transitions, or vice-versa. 
(Note that the demon must possess at least three states in 
order to exhibit directed rotation.) To keep track of the net 
CW rotation, we introduce an integer variable x, whose value 
increases by one unit whenever the demon makes a transition 
from C to A, and decreases by one unit with each transition 
from A to C. 

We next describe the interaction between the demon and a 
single bit, with states labelled and 1, Fig. 2(b). The demon 
and bit together form a composite system with six states, 
AO, •••Cl, depicted in Fig. 2(c). The five lines, or edges, 
connecting pairs of states in this network specify the allowed 
transitions for the composite system. The demon can jump 
between states A and B, and between B and C, without in- 
volving the bit; these transitions are represented by the edges 
AO-BO, BO-CO, Al-Bl and Bl-Cl. Additionally, the demon 
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Fig. 1. A sequence of bits moves at constant speed past the three-state demon, which interacts with the nearest bit (shaded) and a thermal reservoir (not shown). To 
model a positive external load / > 0, we imagine that a mass 771 is lifted by an amount A/i every time the demon makes a transition U — >• A, and lowered with each 
transition A — > C. See text for details. For / < 0, the mass can be pictured as hanging off the rights side of the small circle, so that transitions C —> A lower the mass 
and transitions A — > G lift it. 



B 



B1 




A \, 



1 

A 








(a) 



(b) 



(c) 



Fig. 2. Schematic depiction of the demon, the bit and their composite 6-state system, (a) The state of the demon is indicated by an arrow pointing in one of three directions 
(A, B, or C) on the face of a dial, (b) The bit is represented as an arrow pointing either up (1) or down (0). (c) Network depiction of the composite system, showing allowed 
transitions. The edge that connects Al and CO represents the coupling between the demon and bit. 



can make a transition from C to A if the bit simultaneously 
"flips" from to 1, or from A to C if the bit flips from 1 to 
0, as indicated by the line connecting Al and CO. We model 
these transitions as a Poisson process, where Rij is the prob- 
ability per unit time to make a transition to state i, when the 
system is in state j, with i, j £ {AO, ■ • ■ Cl}. For the moment, 
we set Rij = 1 for each of the ten allowed transitions (two per 



edge) depicted in Fig. 2(c). 
in our model. Because Ri 



These rates set the unit of time 
Rji for every edge, we have im- 
plicitly assigned the same energy to all six states [40]. Under 
these rates, the demon and bit relax toward equilibrium, in 
which all six states are equally likely. This relaxation occurs 
on a time scale of order unity: r r ~ 1. 

The network of states in Fig. 2(c) forms a linear chain. 
Because this chain contains no closed loops, the model cannot 
yet exhibit directed rotation, only back-and-forth excursions 
along the chain. To introduce the possibility of rotation, let 
us now imagine a bit stream (see Fig. 1): a sequence of bits ar- 
ranged at equally spaced intervals along a tape that is pulled 
through at constant speed, for instance by a frictionless fly- 
wheel. The demon remains at a fixed location, and interacts, 
in the manner discussed above, only with the bit that is cur- 
rently closest to it. Let r _1 denote the rate at which the bits 
pass by the demon, each interacting with the demon for a time 
interval of duration r before the next bit in the stream takes 
its place. Thus r determines the extent to which the compos- 
ite system approaches equilibrium during one such interaction 
interval; for r < r r ~ 1 the system hardly evolves during the 
interval, whereas for t> 1 the demon and the bit effectively 
reach equilibrium. Finally, let b n and b' n denote, respectively, 



the incoming and outgoing state of the n'th bit in the stream. 
The state of any bit can change only when it is interacting 
with the demon. 

The incoming bits are statistically independent of one an- 
other, each with probability po to be in state 0, and p\ to be 
in state 1. The excess parameter 

8 = p -pi [ 1 ] 

quantifies the excess of 0's in the incoming bit stream. 

To understand how the demon can exhibit directed rota- 
tion, in this paragraph let us consider the case in which every 
bit in the incoming stream is set to (as in Fig. 1). The 
demon interacts with the n'th bit during the n'th interaction 
interval, t n < t < t n +i = t n + t. At the start of this in- 
terval, the composite system begins in state AO, B0 or CO, 
since b n = 0. From t = t„ to t n +\ the system evolves among 
the network of states depicted in Fig. 2(c). It might repeat- 
edly pass forward and back along the edge connecting CO to 
Al, resulting in alternating increments and decrements of the 
counter x(t). At the end of the interaction interval, if the 
system is found in state AO, B0 or CO (i.e. if b' n = 0) then 
we can infer that every transition CO — > Al was balanced by 
a transition Al — > CO, hence A\n = x(*»+i) ~~ x(tn) = 0. 
If the system instead ends in Al, Bl or Cl (b^ = 1), then 
the counter has advanced by one net unit: A\n = +1. At 
t — t n +i, the n'th bit is replaced by the (n + l)'th bit, and 
the next interval commences. Thus if the composite system is 
in state Bl at the end of one interval, then at the start of the 
next interval it is in state B0. This effective transition does 
not imply an actual change in the state of a given bit, but 
simply reflects the replacement of an outgoing bit in state 1 
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with an incoming bit in state 0. (Note that Fig. 2(c) depicts 
only the actual transitions that may occur during one interac- 
tion interval.) Over time, the demon interacts with a sequence 
of bits, all initialized to 0, and the outgoing bit stream con- 
tains a record of the demon's rotary motion: each occurrence 
of an outgoing bit in state 1 indicates one full CW rotation, 
Ax = +1. Since the value of the counter can only increase or 
remain unchanged from one interval to the next, in the long 
run x(t) grows with time and the demon undergoes directed 
CW rotation. 

If the incoming stream were instead composed entirely of 
l's, then full CW rotations would be prohibited, and full CCW 
rotations would be documented as outgoing 0's. For a more 
general distribution of incoming bits, the net change in the 
counter during the n'th interaction interval is 



AXn = t4 - b n , 



[2] 



and the outgoing stream provides partial information regard- 
ing the demon's gyrations. 

The demon eventually reaches a periodic steady state in 
which its statistical behavior is the same from one interval to 
the next. If the outgoing bit stream is then characterized by 
values p' , p[ and 8' = p' — p[, then the average number of 
full CW rotations per interaction interval is 



$ = (AXn) = Pl - Pi 



2 (*-*')■ 



[3] 



We will use $ as our measure of directed rotation, and we will 
call it the circulation. 

We have solved for the periodic steady state, obtaining (as 
described in the Methods section below) 



[4a] 



where 



K(t) 



2t (1 + 8a + 4V3/3) - (2 + 7a + 4^/3)e" 



3- (2 + a)e- 2T 

[4b] 

and a — cosh(y / 3r), f3 — sinh(\/3T). The function K(t) 
decreases monotonically from K(0 + ) = 3 to K(oo) = 0, 
hence the magnitude of the circulation increases with r, from 
<E>((5; + ) = to $(<5; oo) = 8/2. These values are easily under- 
stood. When r — > 0, the probability to observe any transition 
during a given interaction interval vanishes, and therefore so 
does <&. When t 3> 1, during each interaction interval the 
composite system has sufficient time to relax to equilibrium, 
with all six states in Fig. 2(c) equally likely, hence 8' = and 
<E> = 8/2 (Eq. 3). Interestingly, the average rate of rotations, 
uj = $/t, achieves its maximal value oj = 8/6 at r = + , and 
then decreases with r. 

Since the quantity in square brackets in Eq. 4a is non- 
negative, the demon effectively converts an excess of 0's or l's 
into directed CW or CCW rotation. We now harness this rota- 
tion to an external load, by attaching a mass m to the demon 
in such a way that the mass is lifted a distance Ah whenever 
the demon makes a transition from C to A, and is lowered 
by Ah for the reverse transition (Fig. 1). The correspond- 
ing energy, ±mgAh, is exchanged with the thermal reservoir: 
with every transition CO — > Al, heat is withdrawn from the 
bath to lift the mass, and with every transition Al — > CO that 
energy is released to the bath. (There is no exchange of en- 
ergy with the flywheel that pulls the bits past the demon, in 
particular the flywheel does not contribute energy to lift the 
mass.) To incorporate these considerations into our dynam- 
ics, we modify the transition rates in accordance with detailed 



balance [40]: 



Rai,co 
Rco,ai 



f 



rag Ah 
k B T 



> 0, 



where T is the temperature of the thermal reservoir and /cb 
is Boltzmann's constant, with all other rates Rij unchanged. 
The parameter / quantifies a thermodynamic force that favors 
CCW rotations (Rco,ai > Rai,co) as gravity tugs the mass 
downward. In terms of Fig. 2(c), Eq. 36 effectively increases 
the energies of states Al, Bl and Cl by an amount mgAh, 
relative to states AO, BO and CO, reflecting the energy that is 
withdrawn from the reservoir during the transition CO — > Al. 

If the demon interacts with a single bit for a sufficiently 
long time then the two will reach equilibrium, with 



Pao ~ Pbo ~ Pco 



Pai — Pbi — Pci 



1 



[6a] 



where Z = 3(l + e / ). After summing over the states of the de- 
mon, the equilibrium probabilities for the bit itself are found 
to satisfy 

P^-PT =tanbY^ =e , [6b] 



where the weight parameter, e, is a rescaled version of the 
thermodynamic force, /. 

Eq. 36 leaves us with some freedom in assigning the rates 
Rco,ai and Rai,co- We have chosen 



Rai,co = 1 — e 



Rco, 



l + e 



[r] 



With this choice, we are again able to solve analytically for 
the periodic steady state, obtaining (see Methods) 



*(*,e; t) 



S-e 
2 



3 (r) + ¥ (T ' ) 



with 



J(r,eS) 



[8a] 



[8bl 



(l-e- r )[2e- 2T (a + V3P- 1) 



[3(1 - eSe-r) - (1 - eS)(2 + a) e - 2 -][3 - (2 + a) e - 2 -] 

and K, a and /3 as in Eq. 4. These results extend to negative 
values of /, if we interpret these as indicating that gravity 
exerts a clockwise torque (see caption of Fig. 1). Eq. 8, our 
central result, is then valid for |e| < 1, \8\ < 1, and < r < oo. 

In the limits r = + and r — > oo Eq. 8 gives $ = 
and $ — > (8 — e)/2, respectively. The latter reflects equili- 
bration between the demon and each bit: p' 01 = p^\, hence 
8' = p' Q — p[ — e (see Eqs. 3 and 6b). On the right side of 
Eq. 8a, the quantity in square brackets is non-negative, as de- 
termined by numerical inspection, and the prefactor indicates 
a competition between the parameters 8 and e. When 8 > e, 
the incoming bits contain a surplus of 0's, relative to the equi- 
librium proportions (Eq. 6); during each interaction interval 
the composite system relaxes toward equilibrium, generating 
CW rotation as 0's are converted to l's, on average. Similarly 
when 8 < e the relative surplus of incoming l's generates 
CCW rotation. When 8 = e there is no directed rotation, as 
the bits arrive distributed in the equilibrium ratio. 

The new term appearing in Eq. 8a, e8J/6, does not affect 
the sign of the quantity in square brackets. However, there 
is a succinct way to describe its action: it goes against the 
loser if there is a competition between 8 and e, and against 
both if there is cooperation. This follows from the inequal- 
ity J(r,e8) > (determined by numerical inspection). E.g. if 
8 > e > 0, so that in competition 8 wins giving rise to $ > 0, 
then the term e8J/6 makes a positive contribution to <I>. If 
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Fig. 3. Behavior of our model as a function of 8 and e, for r = 1 and 10. The demon can act as an engine (lightly shaded region), an eraser (darkly shaded) or a dud 
(unshaded). These regions are delineated by the lines e = and e = 5, together with a third line (see text), shown passing through the second and fourth quadrants, which 
depends on T and is nearly but not exactly straight. The symbols + and — indicate the sign of AS, the average change in disorder per bit. The circulation $ is positive 
(CW) in the lower right half of the figure, and negative (CCW) in the upper left. 



5 > > e, so that both parameters favor CW rotation, the 
contribution due to this term is negative. 

We now explore the thermodynamic and information- 
processing behavior of our device, and we ask when it might 
perform a "useful" service. Consider the square region rep- 
resenting allowable values of the excess parameter 8 and the 
weight parameter e, depicted in Fig. 3 for r = 1 and 10. The 
line e = 8 is the contour of zero steady-state rotation: to the 
left of this line the rotation is CCW (<E> < 0) and to the right 
it is CW (<!> > 0). The product W = fc fl T/$ represents the 
average work that the device delivers to the mass, per interac- 
tion interval. Since sign(e) = sign(/), the two lightly shaded 
triangles in Fig. 3 (e<& > 0) are the regions in which the device 
acts as an engine, converting heat from the thermal bath into 
work to lift the mass. For example, when 8 > e > gravity 
exerts a CCW torque, but the excess of incoming O's generates 
a greater CW torque. 

Now consider the quantities 

S b = - ^2 Pilnpi and S£ = - ^ p[ Inp*'. [9] 

i=0,l i=0,l 

For convenience we will call these the disorder (per bit), al- 
though this terminology ignores correlations between succes- 
sive bits in the outgoing stream. St quantifies the information 
content of the incoming stream, and is related to its capac- 
ity to record new information, in the following sense. When 
Sb — the incoming stream is a blank slate composed entirely 
of O's (or entirely of l's), and the outgoing stream contains a 
faithful record of CW (or CCW) rotations, as discussed ear- 
lier. When Si, = In 2 (its maximum possible value) the incom- 
ing stream is saturated with an equal mixture of O's and l's, 
and in this case the outgoing stream does not chronicle the de- 
mon's rotations. We will interpret the difference AS = S' b — Sb 
as a measure of the degree to which new information is written 
to the bits, as they interact with the demon. 

Since the rotation of the demon couples tightly to the flip- 
ping of bits (Eq. 2), the line e = 8 (where $ = 0) is a contour 
along which AS(S, e; r) = 0; here, there is no net rotation and 
no net change in the bit statistics: p'o = po and p[ — pi . The 
other solid line depicted in Fig. 3, running from the upper left 
to the lower right, is also a contour along which AS = 0, rep- 
resenting the inversion of bit statistics: p' Q = pi and p[ = po- 



The two lines divide the (8, e)-square into four regions, with 
the +'s and — 's in Fig. 3 denoting the sign of AS in these 
regions. 

We see in Fig. 3 that AS > whenever our device acts as 
an engine. This is consistent with the proposition that a me- 
chanical demon, in order to convert heat to work, must write 
information to a memory register. Indeed, Fig. 3 shows that 
the greater the storage capacity of the incoming bit stream, 
the larger the mass the demon can hoist against gravity: when 
presented with a blank slate (8 = ±1) the demon can lift any 
mass; but when the incoming bit stream is saturated (8 — 0) 
the demon is incapable of delivering work. Thus a blank or 
partially blank memory register acts as a thermodynamic re- 
source that gets consumed when the demon acts as an engine. 

In the above description, the demon is an active rectifying 
agent and the bit stream merely a passive receptacle for infor- 
mation. From another perspective, however, the interaction 
with the demon presents an opportunity for the bits to evolve 
to a more disordered sequence of O's and l's. The bits' role 
then appears more assertive: their evolution toward greater 
randomness is what drives the engine, and the demon simply 
facilitates the process. 

In the darkly shaded regions in Figs. 3, the demon acts 
as an eraser, removing information from the memory register: 
AS < 0. For example, if 8 = 0, / > 1 (i.e. e w 1) and r > 1, 
then the bits arrive in an equal mixture of O's and l's, but each 
bit has sufficient time to equilibrate with the demon, hence at 
the end of each interaction interval the composite system is 
almost certainly in state AO, BO or CO (Eq. 6). As a result, 
the outgoing bits are nearly all O's, and the memory is effec- 
tively wiped clean as the mass drops by a distance Ah/2 (on 
average) per interaction interval. 

Our model thus reflects the interplay between two effec- 
tive forces, one associated with the randomization of the bits 
and the other with the pull of gravity. When our model acts 
as an engine, it consumes one resource - a blank or partially 
blank memory register - to build up another: the gravita- 
tional potential of the mass. When it acts as an eraser the 
roles are reversed. In the unshaded regions in Figs. 3, both 
resources are squandered (the mass falls and the bits' disor- 
der increases) and our model is a dud, accomplishing nothing 
useful. 
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Our model satisfies the inequality 

W<k B TAS, [10] 

for any e, 8 and r, with the equality holding only when 
e = 8. (See Supplementary Material.) Thus, the increase 
in the information content of the bit stream places an up- 
per limit on the work that can be delivered, when the model 
is an engine. Analogous inequalities arise in the context 
of feedback control, where an external agent manipulates 
the system on the basis of outcomes of explicit measure- 
ments [22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33]. When 
our model acts an eraser (AS < 0), Eq. 10 reveals the min- 
imum amount of work that must be supplied, by the falling 
mass, in order to reduce the information content by a given 
amount. In the case of full erasure (S' b = 0) this becomes 
Landauer's principle, \W\ > k B TSb- Note that if we are will- 
ing to assign thermodynamic meaning to the randomness in 
a string of data, Eq. 10 can be interpreted as the second law 
of thermodynamics (or rather as a weak statement of it, since 
S' b ignores correlations between outgoing bits): the decrease 
in the entropy of the reservoir, — AS r = W/ksT, must not 
exceed the increase in the entropy of the bit stream: 

AS r + AS>0. [11] 

While both sides of Eq. 10 approach zero as e — > 8, their 
ratio approaches unity in that limit (see Supplementary Ma- 
terial). Thus in the immediate vicinity of the line e = 8, the 
bound represented by Eq. 10 becomes saturated, and our 
model behaves with maximal efficiency, acting as a thermo- 
dynamically reversible engine or eraser. Note however that 
the rate at which the demon either delivers work or erases 
information approaches zero in this reversible limit. 

We conclude by mentioning two extensions of the present 
work. First, we can reformulate our model as one in which 
the bits arrive as a sequence of matched pairs, or dimers, 
t>2fc-i = b 2 fe (e.g. 00 11 11 00 11 • • • ), and the demon interacts 
with the bit stream, one dimer at a time. Even if the incoming 
stream contains an equal proportion of 0's and l's, the demon 
is able to lift the mass, effectively by "digesting" the pairwise 
correlations between the bits, which depart in a less ordered 
sequence (e.g. 01 11 10 10 11 • • • ). This suggests the possibility 
of a more complex information-processing engine, driven by 
the recognition of specific patterns in the bit stream. 

We have also sketched a mechanistic version of our model, 
composed of frictionless paddles, pulleys and axles immersed 
in a dilute gas. While highly idealized, this model is more eas- 
ily visualized as a material physical system than the discrete- 



state model described in the present paper. See Ref. [8] for 
an analogous model of a Turing machine. 

Methods 

To obtain e;r) we solve for the periodic steady state of 
the demon, then we use that solution to determine the distri- 
bution of outgoing bits (po,p[)- The value of $ then follows 
from Eq. 3. 

Let 75x3 denote the transition matrix whose component 
T^v gives the probability to find the demon in state /i G 
{A, B, C} at the end of one interaction interval, given that 
it began in state v at the start of the interval. Explicitly, 

T = P D e nT M. [12] 

Here, A^6x3 = ^ p°i ^' with I the 3x3 identity matrix; 

7?.6x6 is the transition rate matrix whose elements {Rij} are 
discussed in the main text; and (Pd) 3x6 = (I, I)- Specifi- 
cally, if q = (qo,qo,qo) T gives the probability distribution 
that describes the demon at the start of one interval, then 
the six-component vector Mqg gives the combined state of 
the (initially uncorrelated) demon and bit. The factor e nT 
propagates this distribution for the duration of the interval, 
and Vd projects out the state of the bit, so that q T = Tqo is 
the statistical state of the demon at the end of the interval. 

In the periodic steady state, the initial probability distri- 
bution of the demon is given by the vector satisfying Tq pss = 
q pss , whose uniqueness is guaranteed by the Perron- Frobenius 
Theorem [41]. At the end of the interaction interval the state 
of the (now correlated) demon and bit is e KT Mq pss . The 
statistics of the outgoing bit are obtained by projecting this 
correlated state to that of the bit: 

( P0 \ d JKr pss / 1 1 1 \ 

pi ) - Voe • Mq ' Vb = 1 1 1 ) ■ 

[13] 

Thus to obtain (po,p\) we must determine 7~, solve for its 
eigenstate q pss , and apply Eq. 13. This calculation involves 
a straightforward if tedious exercise in the spectral decompo- 
sition of 1Z, which we detail in the Supplementary Material. 
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Supplementary Material 

Here we detail key steps in the derivation of our expression for $(<5, e;r), and we discuss the inequality W < ksTAS, Eq. 10 
of the main text. 

Solving for $.As explained in the "Methods" section, to solve for $ we first obtain the stationary probability distribution 
qpss Q £ ^ ne transition matrix 73x3- This matrix describes the evolution of the demon over one interaction interval, and is the 
product of three matrices, T = M (Eq. 12). Expressions for Vn and M were provided explicitly in the "Methods" 

section. For e£ (-1,1), the transition rate matrix for the composite demon-and-bit is 



TZ 



/-I 
1 




Vo 



1 

-2 
1 








1 

-2 + e 
1-e 










1 + e 
-2-e 
1 





















1 





-2 


1 


1 


-v 



This matrix has six real, non-degenerate eigenvalues that are (surprisingly) independent of e: 

{Ai} = {0,-c,-l,-2,-3,-d} , 

with 

a = l-V3 , c = 2-V3 , x = l + e 
b=l + V3 , d = 2 + V3 , t/ = 1-e. 

The quantities a, b, x and y will be used momentarily. 

We have found the following spectral decomposition of TZ to be convenient: 
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Here, the columns of U are right eigenvectors of TZ, and the rows of V are its left eigenvectors. We denote the right eigenvectors 
by Ui or and the left eigenvectors by vf or These form a biorthogonal pair of basis sets: vf • Uj = = UiSij, i.e. 
VU = N. Explicitly, 
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and {ni} = {6, 12c, 4, 6, 12, 12d}. Note that since TZ is not symmetric, its left and right eigenvectors differ. The matrices iV 
and A are diagonal. While it is usual to normalize the left and right eigenvectors so that they are biorthonormal (m = 1), we 
have found that the choice of normalization given above leads to less cumbersome expressions in the subsequent analysis. 
In terms of this decomposition, we have 
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where I is the 3x3 identity matrix (see "Methods"). An explicit evaluation yields 
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where a = e T and 



F = 4 + 2a 



G = Aa 2 + a c + a d 



L — 2a 2 — a c — a d 



H = \/3(a c - a d ) 



M = 4 - 4a J 



[21] 
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Solving the equation T q pss = q pss (see "Methods" ) we obtain 

(*- e )(ff-L) 

l ' j 6 — G + e<5(G — 6a ) • L J 

Combining this result with Eq. 13 of the text yields the statistics of the outgoing bits, {p'o,p[), from which we then obtain the 
circulation using the relation <3> = p[ — p\ . 

Relationship between W and A.S. We now obtain Eq. 10 of the main text: W < ksTAS. Since 

W = k B T$f = fc s T$ln^-t^, [23] 
we must establish the non-negativity of the dissipation function: 

nsAS-$ln^>0. [24] 

We will first prove this for the quasistatic case r — ► oo, and then extend it to finite r. Let 

1--X-, 1-X 1 + 1 . 
W = ^ln^ 2~ ln ^" I 25 l 

denote the entropy of a bit as a function of an excess parameter X. 

In the quasistatic limit (specified below by the subscript "oo" ) the outgoing bits reflect full equilibration between the demon 
and the bit; see Eq. 6 of the main text. In that limit we have 

<S>^ 5 -^ = ^>oo , S'^e , AS b ^S(e)-S(8), [26] 

hence 

SI —> S{e) - S{6) - =^oo- [27] 

Now note that 

fi^=0 fore = 8 and = ^— ^ | < [J )[ ^ J J • [28] 

Thus for any fixed value of 8, the function f2oo (8, e) is zero at the point e — 5, and as a function of e it decreases when e < 5 
and increases when e > S. This establishes that Qac > 0. 
We have verified by explicit numerical investigation that 

$(<5,e;r) = t?*^ where < 77 < 1. [29] 

That is, the quantity in square brackets in Eq. 8a of the main text (which we here label rf) falls in the range [0, 1]. While we have 
not been able to establish this analytically, we believe it is related to the fact that all eigenvalues of the transition rate matrix 
1Z are real and non-positive (Eq. 15), with the consequence that the composite demon-and-bit system relaxes monotonically 
toward equilibrium during each interaction interval. This suggests that sign(<3>) = sign($oo), and that the maximum circulation 
is obtained by allowing the composite system to relax fully to equilibrium. 

For finite r, the excess parameter 8' for the outgoing stream is a linear average of <5 and e: 

5' = 5- 2$ = (l-r})5 + rie , [30] 

using Eq. 3 of the main text, Eq. 29 and $oo = (8 - e)/2. Since S(X) is concave (d 2 S'/dX 2 < 0), 



S' b = S(8') > (I-77) S(8) + r, S(e) 

= S(8) + V [S(e)-S(8)]. 



[31] 



From Eqs. 26, 27 and the non-negativity of f^, we have 



5(e) - 5(5) > $00 In [32] 

Combining Eqs. 31 and 32 we get 

5t > 5(5) + 77*00 In =( 5 6 + $i n i±£ [33] 

1 — € 1 — e 

which is the result we set out to establish (Eq. 24). 

As mentioned in the main text, the inequality W < ksTAS can be viewed as a weak statement of the second law of 
thermodynamics, where the weakness is due to the neglect of correlations in the outgoing bit stream. 1 If we accept an 



1 Empirically, these correlations are quite small, though non-zero. 
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equivalence between thermodynamic entropy and the information content of a random data set, then we might expect the 
second law to be represented more accurately by the inequality 

W < k B TAH , [34] 

where AH = H' b — Hb is the change in the information entropy per bit, including correlations among the outgoing bits. For our 
model Eq. 34 can be derived directly from general properties of Markov processes, without involving our solution for $(<5, e; r). 
We omit this derivation, which makes use of relative entropy 2 as a Lyapunov function 3 characterizing the relaxation of the 
demon and bits. Since Hb = Sb (the bits arrive uncorrelated) and H' b < S' b 4 , we get 

AH < AS, [35] 

which provides an alternative derivation of the inequality W < UbTAS. 
Finally, setting ksT = 1 for convenience, we establish the result 

mentioned near the end of the main text. Taking the partial derivatives of the quantities 

W = $lni±^ and AS = S(5') — S(5) [37] 

with respect to e, at fixed 8 and r, we get 

2$ 
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(using 5' = 5 — 2$). Along the line e = 8 we have W = AS = as well as 

dW OAS 



Eq. 36 then follows by l'Hopital's rule. 
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4 See the reference in footnote 2. 
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